Modified Error Function with Added Terms for the Backpropagation Algorithm
نویسندگان
چکیده
We have noted that the local minima problem in the backpropagation algorithm is usually caused by update disharmony between weights connected to the hidden layer and the output layer. To solve this problem, we propose a modified error function with added terms. By adding one term to the conventional error function, the modified error function can harmonize the update of weights connected to the hidden layer and the output layer. Thus, it can avoid the local minima problem caused by such disharmony. Moreover, some new learning parameters introduced for the added term are easy to select. Simulations on the modified XOR problem have been performed to test the validity of the modified error function.
منابع مشابه
An Modified Error Function for the Complex-value Backpropagation Neural Networks
The complex-valued backpropagation algorithm has been widely used in fields dealing with telecommunications, speech recognition, and image processing with Fourier transformation. However, the local minima problem usually occurs in the process of learning. To solve this problem and to speed up the learning process, we propose a modified error function. we added a term to the conventional error f...
متن کاملA Robust Distributed Estimation Algorithm under Alpha-Stable Noise Condition
Robust adaptive estimation of unknown parameter has been an important issue in recent years for reliable operation in the distributed networks. The conventional adaptive estimation algorithms that rely on mean square error (MSE) criterion exhibit good performance in the presence of Gaussian noise, but their performance drastically decreases under impulsive noise. In this paper, we propose a rob...
متن کاملIdentification of outliers types in multivariate time series using genetic algorithm
Multivariate time series data, often, modeled using vector autoregressive moving average (VARMA) model. But presence of outliers can violates the stationary assumption and may lead to wrong modeling, biased estimation of parameters and inaccurate prediction. Thus, detection of these points and how to deal properly with them, especially in relation to modeling and parameter estimation of VARMA m...
متن کاملOn improving APIT algorithm for better localization in WSN
In Wireless Sensor Networks (WSNs), localization algorithms could be range-based or range-free. The Approximate Point in Triangle (APIT) is a range-free approach. We propose modification of the APIT algorithm and refer as modified-APIT. We select suitable triangles with appropriate distance between anchors to reduce PIT test errors (edge effect and non-uniform placement of neighbours) in APIT a...
متن کاملDesign of a Model Reference Adaptive Controller Using Modified MIT Rule for a Second Order System
Sometimes conventional feedback controllers may not perform well online because of the variation in process dynamics due to nonlinear actuators, changes in environmental conditions and variation in the character of the disturbances. To overcome the above problem, this paper deals with the designing of a controller for a second order system with Model Reference Adaptive Control (MRAC) scheme usi...
متن کامل